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ABSTRACT 


J 


The  Kalman  Filter  is  a  widely  used  procedure  in  tracking  algorithms.  When 
normality  assumptions  are  violated,  the  Kalman  Filter  performance  tends  to  degrade. 
In  this  thesis  a  new  procedure  is  introduced  for  accommodating  non-normal  properties 
of  measurement  error  distributions.  The  procedure  is  developed  for  the  multi-obser/er 
situation.  Simulation  experiment  results  are  presented  and  numerical  comparisons  are 
made  between  the  Kalm.an  Filter  performance  and  that  of  the  new  procedure. 
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1.  INTRODUCTION 


Tracking  algorithms  are  widely  used  in  modern  technology.  Perhaps  the 
most  commonly  used  algorithm  is  the  Kalman  Filter  (KF)  ',cf.  [Ref.  1]  and  [Ref  2]  ^ 
which  is  based  on  the  following  assumptions; 

a)  The  target  movement  model  is  Itnown.  and  has  normally  distributed 
tluctuations. 

b)  Tlte  sensors  tracking  the  targe:  provide  unbiased,  normally  distributed 
measurements  of  current  target  ‘‘position”. 

If  the  assumptions  are  satisfied.  KF  is  the  best  algorithm  possible.  In  practice, 
however,  the  normality  assumption  may  not  be  justified,  and  the  KF  performance  is 
iegraded.  number  af  modifications  of  the  KF  have  been  made  by  iilTerent  authors 
based  either  on  heuristics,  analytic  derivations,  or  botn  in  order  to  improve  KF 
performance  in  different  situations  tef  [Ref  3]  and  [Ref  -1]  ). 

In  this  thesis  a  tracking  procedure  is  developed  for  the  following  one-dimentional 
basic  land  classical)  model: 


a) 

b) 


0.-1  =  • 

n  1  rt 

V  ^  =  0 

•  n-^  [j  n- 


+  6  _  1  ; 
n-  1.;’ 


«  =  0.1,2,...x 

7=  1.2.3,.. .m  t7  =  0.1.2....^ 


where 


1  is  the  tarset  rositicn  after  time  sten  n 

■  ,  is  the  measurement  if  target  ■‘position"  obtained  by  sensor  '  at  time  step 
i—  i. 


in  the  mouei  the  target  performs  a  random  '-vaik  with  normally  distributed  steps  '.vith 
mean  zero  and  known  variance  t‘.  and  the  sensor's  m.easurement  errors  are 
unbiased  and  t-distributed  witii  known  parameters  where  d.  is  the  degrees  of 

Feedom.  ir;d  iT  is  ‘lie  caie  parameter  of  the  ‘-distribution.  T'.iere  ire  ni  'tensors. 

fins  model  loiates  tnc  classical  .KF  assumptions  ■>>'  allowing  thick-taiied 
'  outlier-oronc)  measurement  errors.  This  model  is  designed  for  the  situation  '.vhere  m  is 


small,  and  it  isn't  possible  to  make  use  of  the  central  limit  theorem  elTect. 

Tile  mathematical  tractabiiity  of  the  model  is  complicated  by  the  fact  that  there 
;s  no  simple  analytic  form  for  an  estimate  of  location  of  the  target  '.viih  Student-t 


measure.ment  errors. 


w 


a 


In  Chapter  II  two  possible  ways  to  derive  the  classical  KF  equations  are  given. 
These  derivations  will  help  to  motivate  the  procedure  suggested  in  Chapter  III.  Some 
practical  considerations  regarding  the  implementation  of  the  procedure  will  be  given  in 
Chapter  III  as  well. 

In  Chapter  IV  the  simulation  experiment  implementing  the  procedure  derived  :n 
Chapter  III  is  described  and  numerical  performance  comparisons  of  the  KF  and  the 
new  procedure  are  presented. 

C.iapter  V  contains  anal  remarks  about  the  new  filter  and  farther  tonics  for 
future  development. 

.\ppendix  .A  contains  tabulated  resuits  of  simulation  cxper.rnent. 

.Appendix  B  contains  details  on  simulation  experiment  implementation. 

.Appendix  C  contains  graphical  presentation  of  the  results  from  .\npendix  .A. 


9SmS 
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II.  KALMAN  FILTER 


;  ;'.c  '.isiL  :nouc;  ;'jr  :iie  cuissic.ii  Kalman  I'litor  is  tliat  :iic  target  moves  according 
.r.aor'.;  vaik  aiui  ■.'.ormaiiv  oiMnbiitca  step  sizes,  llie  measurement  errors  arc 
.n.u  't.niiixailv  '.naependciu  iVoin  target  “position",  i.e.: 

'L  _  =  'V.  ~  t,_,.  it I  ^  »  = '),  1 ,2....  to 

■ -  =  d,  _  ^  i.y 7  =  i  /;  = ‘M  ,2,...  to 

.  jr.  j  ti'.rce  ntcrnative '-vavs  to  obtain  t'.ic  K  F  euu.itions; 

.e  '....  antt.ni  .;^cailood  osinnation  anproacit. 

..c  ;.;:.;:;n;:n  ■..r'.ance  anma.'ca  estimation  approacii. 

..e  ..;:.;nu/-t:on  ;i' tiie  mean  suiiare  ol' estimation  ci  roil  0  —  0  F 

•  n  n 

V.  >:ens;en  anu  stncrgi'-m  oi'  tne  First  two  metiiods  will  lead  us  to  the  procedure 
.n  .pter  ill. 

ma.xi.mlm  likelihood 

:  e:  0.  !'e  Ftc  estnnate  ot  0  after  time  step  n  artd  C  he  its  variance.  Since  §  is 
■  iistrFouteJ  ’.vith  mean  0  and  variance  C  ,  the  conditional  likelihood  of 


•I  -  ! I 


.)  ■) 


.  I 

■  - 1 


:2.1) 


.  n  I. 


1 


In  the  K1  case  normality  is  preserved  at  each  estimation  step  as  can  be  easilv 


rinding  the  maximum  for  this  likelihood  is  equivalent  to  finding  minimum  of  the 


exponent. 


m 

,m(  X 


(0  J— y  T  X 

1  I  ; 


1  =<i  J 


(dropping  the  first  subscript  on  die  v^4.|'s  and  using  =  ‘or  a  compact  notation). 
Expanding  the  squares  we  obtain 


.-n  V  ^ 


Q(9  =  ^  ^  '-i+Y'-d 

^  Tt-1  -  y  T  +  l  -  y  -  y 

;=0y  ;=Jj  J  J 


riiis  simple  uuadratic  expression  is  minimised  by  letting 


y  -''•I-  y 


n  +  I  i 

V  - 


I  V  i 


Since  (KA)  is  a  linear  equation  we  may  immediately  obtain  the  variance  of  the 


estimate. 


VaJ  X  a ) 


m  y 

V  J. 


:  ,  =  fanO  , 

1  —  1  I  — [ 


V  1 


V  1  i  - 

-0^^  “o^ 


Euuations  (.x.  1 )  and  {K.2)  are  the  onlv  ones  needed  to  imnlemcnt  the  KF. 


d.  MINI.MUM  VARI.ANCE 

Ciiven  >'q  =  0,j  and  7=1 . ni  \  it  is  desired  to  get  an  unbiased 

minimum  variance  estimate  (L'.MVfi)  ofG^^^j  . 

Since  V, .•••J'  are  all  unbiased  estimates  of  0  a.  n  anv  linear  combination 

'  ij  1  ’  n‘  I  ' 

}  I  =  ^  I  ►  i  Ot  /  ( ) 

l>  ()  r  I  in  ''  ' 

constrained  by  Ya  =  1  will  also  he  an  unbiased  estimate  ofO  ,  ,  . 


Since 


1 


So,  once  again  the  final  equations  are  equations  (AM)  and  (A'.2) 


(A.l) 


0  ,  =  H  = 

a-h  i 


m  y 


V  1 

j=o‘^j 


.K.2) 


C  =  min  V 

l 


1 


/t 

j 


Note  that  the  minimum  variance  approach  does  not  require  normality  assumptions, 
but  normaiitv  assumnciotis  maKc  ;t  euuivalcnt  to  the  maximum  likelihood  approach. 


in.  W-FILTER 


Now  to  return  to  the  basic  model,  target  motion  is  a  random  walk  with  normal 
stop  size,  -lut  the  ni  sensors  have  independent  Student-t  uistnbuteJ  measurement 
errors. 


i'he  basic  modei: 


a) 

bt 


-■  .*1-^1,/ 


■''I  T  l 
^  6 


n  +  Ij’ 


It  -.s  .rssutued  tiiat  our  procedure  is  producing  unbiased  approximately  normally 

A 

discrmuteu  estimates,  iiiis  means  that  alter  time  step  0  ,  :s  approxinuieiy  normally 
aistributeu  'vuh  mean  0  and  variance  C  .  This  is  the  same  assumption  as  used  by 
tRe!'.  3|  and  [Ref.  d].  Based  on  this  assumption  we  need  to  construct  0^^  ,  and  ^  . 

A.  THE  BEST  0^  a.  I 
1.  The  Criterion 

A 

Based  on  tlie  assutnption  above,  the  conditional  likelihood  given  0^ 

and  ;•  _  ,  . ,r  „  has  the  form: 

”  T  1  .  .  'I  I 


A  •> 

(0  ,  i“ 

1  ■«  -“  1  t 


■n 


ci(i  i 

V  1  —  1 

,  /  '  'I  ^  'I  1 

> 

i  >  1 

■» 

1  ^1 

a 

^  d 

d.  I, 


viiere  i,/  '  .s  some  constant  ■aerenuing  on  tlie  aegroes-or-  reeaum  parameter  a  oi'  tne 
■'  'Ciisor.  .utliouan  .t  .s  possioie  to  look  for  me  maximum  .ikeiiiioua  rouu.  taking 
'hat  approach  has  the  lollowmg  two  interrelated  potential  problems.  I'lrst  there  may 
be  niuitiple  local  maxima  present.  In  an  extreme  case  there  im.y  be  as  many  as  tn  +  I 
local  maxima.  wSec  [Re!'.  4j  lor  local  maxima  conditions  .-.malv  as  when  'U=  1.)  Second, 
in  tl'.e  multiple  ma.Mina  situation,  the  global  maxima  ma;.  lie  tall  and  skinny,  not 
liaving  much  likelihood  to  support  it.  One  would  not  like  to  commit  all  belief  on  the 
basis  of  sucli  evidence. 


To  deal  with  these  problems  use  the  following  (smoothing)  approach  will  be 
used:  instead  of  choosing  ^^4-1  to  maximize  the  probability  of  having  in  an 

inlinitcsimal  probability  element  dO  around  ,  the  estimator  will  be  chosen 

so  us  to  maximize  the  probability  of  having  0.^,  in  an  interval 
(0,.^  [  ~  1  w],  the  later  interval  having  a  finite  (usuaily  non-zero)  predetermined 

length  I-,'--.  In  other  words  the  concern  is  not  having  an  estimate  exactly  "on  the  spot  ’ 
but  ratlier  naving  it  witliin  distance  w  from  true  value  of0,j_  ^  . 

In  mathematical  terms  the  approach  wiil  be  to  fnd  the  solution  to  the 
equation; 


W  1  a) 


maxKQ  ,) 


0 


n  I 


ft)  U) 

1  -t  I  A 

max  Lld0  ,y  . . y  ,  )dC, 

^  f'  i->-  l.r  ■'  Tt-  l,m 

1  1 


In  the  equation  (ir.l.u)  .v  is  serving  as  a  tuning  parameter  and  has  the 
following  elT'ect  on  the  solution: 

'.Vhen  w  =  0  solving  the  equation  (ir. l.n)  is  equivalent  to  finding  maximum 
iikeiiiiood  point. 

\\'iien  iw>0  and  finite,  equation  (IT. l.u)  tends  to  down-weight  skinny  peaks 
more  than  fat  ones. 

U'l'.cn  '.V  is  large  enough,  equation  (JIM. a)  will  have  a  unique"  solution. 
However  it  is  generally  neitlier  required  nor  optimal  to  use  very  large 
v..uues  for  w. 

■Mien  .V  approaci'.es  mliniiy.  any  value  of  0^  _  I  will  vansfy  the  equation. 

.  I'.e  uca  n  .;.->ing  a  ;u)ii--:ero  .v  nas  auuuionai  apnem  Miice,  in  ^oine  practical 
situations,  tccurrcnce  of  a  large  tracking  error  may  degraue  sensor  performance  ;'or 
eonsceuiive  measurements.  (Such  sensor  dependence  on  tracking  performance  is  not 
.'ellcete.i  ;n  'he  model.) 

1  The  Snlulion  Technique 

.•moing  a  ^oiu^on  ;br  euuation  iir.l.ai  directly  .luoi'.cs  .an  e.xiKiustive  ^eareii 
■Vita  i’.umeneal  mtegr.ation;  not  a  very  exciting  prospect  at  first  sight,  lloweser  it  iias 
the  advantage  of  algontlimic  simplicity  and  guaranteed  global  i.iaxiina. 


‘Since  the  likelihood  function  is  positive  and  as\  mptotically  approaches  zero 
when  0  ,  .  approaches  ±  ^  tliis  statement  can  be  easily  proved. 


a.  Aiwly tic j iterative  approach 

Alternatively,  we  may  try  to  find  an  analytic  solution  to  tlie  equation 
(fV.l.a)  by  taking  the  derivative  of  l)  with  respect  to  0^^  ..  j  and  setting  it  equal 
to  zero. 


A  ' 

-  X’  -  • 

I  1  I  n 


dliB  ) 

n  I 


j9 


=  e 


C  -r/ 

n 


M'l 


cid  ) 


T  1 


=  1 


i  -1 


I  -t- 


/  ■  -  -^^1.; 


-u)-9  ■  1 

T  -  l  1  1 


A  1 

1 9  -  ‘u-Q  i~ 

1  iH- 1  1 


c  ~r 


ltd 


;  =  i 


i  -1 


I  /  y  ,  +1^-0  , 

'  I  ''  'i+ij  'j  *  1 


l‘-( 


)  j 


(3-2) 


After  setting  the  derivative  equal  to  zero  and  pcrlbrminc  cancellations 


J  i 


Multiplying  through  by  (  —  1),  expanding  the  squares,  and  pulling  out  the  common 
denominator  of  the  logarithm  gives: 


When  w  approaches  zero,  equation  (IK.l./))  approaches  the  form; 


3=9  +  (C  „ 

4- 1  1  a  —  f  2  , 


^  id  ■+“l){v  “9  ) 

2.  V  J 


- 1  cf  o^-rty  ,  —9  . 

‘  j  j  “''I  —  ij  1+1 


(3.7) 


(The  riciit-most  term  :.s  the  first  Jertvaiive  with  respect  to  of  fhc  logarithmic 

function. ! 

Tins  IS  j\..c:iv  Tic  first-oruor  conaition  ibr  a  .tuximum  likelihood  parameter  value. 

Since  3, _  .mpears  ;n  tne  lognritinnic  term  of  'h'M.i’f  euuniion  {\V.\.b\ 

IS  diilicuit  to  solve  Sirectlv.  One  solution  procedure  is  to  n.'-e  iIIM./m  in  a  recursive 
A 

manner  to  ootain  o_. _  ,  .  The  empirical  e.xpcnence  with  this  approacit  indicates  that 
unless  -e  .s  reiati'. civ  large,  direct  application  of  e-auation  (/['.I. a)  Joes  not  converge'^  in 


b.  Inle"mi  cvuiiiaiion  approtuh 

ii.steuJ  of  a.sing  a  -cpur  ticatcu  .terativc  proceduie,  tiie  simple  e.xhaustive 
search  pri'.ccdure  descrihcJ  hclow  wiil  lie  used. 

Dciine 


,,  r  1  •■••V'  ^  -f  1  ,.r:^ 

J 


0  =  '//..'.nO  ;• 

•  ii.i  v  •I'-  ^ 


(3.8) 


1.1  l.-l' 

_  A 

File  inter',  ri  T  =  0  0  '  includes  nil  reasonahie  candidate  isoints  for  0  .  It  is 

pl>^,l'.lc  to  aiuace  e-iuation  ■■  •'  1  :•>  .it  a  limte  number  ol’  points  (say  2'')  liom  tiie 

i  ;;  j;n...;.-e  '.liit  ::.e  e- oiution  .eu'iireu.  .ind  t.*..e  :lie  one  '.'.ith  smallest 

/\ 

:  ...1  .  .  ..i^tn.n  !  ..  '  .s  ..e  n;i:i..ne  •) 

’  ..e  n.^n  ii  'X;, .;ia  ..e -'oim  ■.  n n ’lie  rniiimn  in  .  loianon  )feauation 
■  1  i.  -  jJe-,  not  _',...i  ..i.tee  e'.ei;  .'c..,  ina\i:n.a.  iio'.ve'.cr  .r.  ome  of  tne  nmuiations 
■n..t  '.  .:e  I'eri  jirneu  t  -^roveu  -..ti'.i.ctors  iiiic^s  tlicre  vcie  manv  cu'-es  alien  tiie 


'■  1..:  pots’  in. 


Aa<  Mia.i':.  I’liis  ger,er..f'v  nappens 


.10  ;  .n^n  u!  .  .-i 

■  .  J  .  f  I  L‘ ! .  'J  !  .  1  J  1  it,  si  ^  .  i  C  -  .4  I  'J  i  I  loi 

.  m  -^nt  itioiiaio.  ..nd  in  generai  aid  ae  more  .;il.;v.ul:  to  sop.e  i^ecause  ol 

.!  n..iOiina  and  "fi.jt  M.nns  "  in  ti.e  .ikeliiiood  function. 


r  lie  I'.tuu  'er  a  ipser'.  er'  o  .s  .arge. 
n  litst  ir  ..oner  ir.mr  Jeri'.atives 


liic  jumps'  between  iterations  may  bo  scry  huge  and  the  estimate  may  reach 

t.a.ii;'.  nni cMs.m.dile  '..ihics. 


Therefore,  the  safest  procedure  for  finding  the  solution  of  equation 
(jr. l.a)  is  exhaustive  search  over  the  interval  f  with  nunieiical  integral  evaluation. 
This  is  the  procedure  used  in  the  simulation  studies  reported  in  the  next  Chapter.  In 
the  simulation,  search  and  integral  evaluation  were  pei formed  in  a  single  DO- LOOP 
(See  -Appendix  B  ibr  detaiis  on  mipicmcntaiion).  The  simulation  was  not  written  with 
computational  elliciency  in  mind,  nevertheless  the  compurational  burden  did  not  .'•cacii 
an  unacceptable  levai. 

B.  \'ARIaNCE  OF  0^^  , 

In  order  to  keep  die  liitcr  ecing  once  ,  has  been  obtained,  it  ;s  necessary  to 
compute  .ts  variance  .  Since  euuatton  l  iL. l.u)  is  implicit  and  equation  (IT. l.bi 

IS  not  linear,  there  is  no  natural  analogy  to  equation  (A'.2). 

1.  Linearization  anproacli 

A 

'one  possible  .I'proacb.  'o  .aictilate  die  variance  ofi)j_,  is  to  .approximate 
equation  ■  l.oi  with  a  linear  equation  obtained  by  a  lirst  oruer  Taylor  expansion  of 

A 

tile  !og..rithm;c  terms  around  |  ,  for  each  j.  C'anteiling  and  i-earranging 

terms  results  m  the  foilowini:  approximation  to  cuuation  (ir.l./Mi 


Empirical  evidence  indicates  that  in  practice  this  approach  performs  ver\- 
badly,  giving  values  for  which  arc  far  too  small.  The  depends  only  on  n  and 
converges  to  a  value  for  large  n. 

2.  Minimization  approach 
ti.  The  Ideu 

Ilasir.g  rOj'c'c'ted  tlic  ui^ovc  linearization  approacii,  a  diilercnt  one  ;s 
introduced  nv  tiic  following  nwtivation. 

'file  "beit"  estimate,  0  _  ,  ,  is  some  ccmoination  ,1  . ^ 

la  tlic  -use  of  the  Ki'  it  is  ^^ossinie  to  pick,  a  haear  coailanation  l.aviag  minimai 
'.anance  aaa  remain  ..onsistent  .van  ma.ximum  iikeiihood  uiueria.  In  tae  '.VF  case 
tins  consistency  no  longer  hoids.  since  generally  the  estimate  obtained  by  finding  tiie 
loiatiua  to  die  eviuaiion  ir.l.u)  wfil  aiifer  'roin  the  mininium  .anance  estimate.  But  in 
Mis  -a.se  i  IS  still  -^os.sfpie  finu  ;  minimum  '■anance  linear  i  unbination  .onstrainea 


\j  ;.ieio  tae  "sest"  '  areiiuv  ka.Gwr.i  .u.lue  forO^^^I  . 

1  !us  means  'iiat  In  order  to  obtain  an  estimate  ol 
to  solve  the  following  constrained  minimization  problem; 

1  he  symboiic  lormuiation  would  be 

m,n  V  =  a 


iriance  ^  we  have 


13.12) 


-  ...  +  a^  =  1 


wnere 


=  r  -. 


j.  F'lymiild  Jki  ’.yaitnn 


■  leu  no  minimi/. .tioii  is  necetsaiv  ino  ,;e  oroisiem  ,,is  .<  mum 


f  jr  notat.om.i  ■iiimii.-itv  tae  .ir'^t  :-ub^v;rmt  .val  m  ..aonred,  .aid  let  n,  =  d 


and  0  =  S^4.]  .  Let  Xj  and  X,  be  Lagrange  multipliers.  I  hc  Lagrangian  formulation 


is  then: 


(3.15) 


Taking  partial  derivatives  with  respect  to  a,  iiid  Xj  .  X,  to  obtain  a  system  of 'n-  .'- 
anear  equations  witli  !>i~  3  unknowns  gives: 


-•■o'*:)  "  -  ^-2  =  '■' 

l:.a.  -  X,.-,  -  X^  =  0 

I  .  . 


2'.-  -1  -  X,'.-  -  X-,  =  0 

n  -n  1-  « 


^  a  V 


a  =  I 


Multiplying  cacii  one  of  die  Hrst  1  es]uaticns  by  the  coriesponding  1  and  adding 
all  toeether  rcsuit.s  in; 


-n  V  » 


Since  =  ! . 

Mu!t;riv;ng  eacii  one  if  lie  I'lrs:  -.n  -  1  equations  by  corresponding 


:ouat;o: 


■  -I.  i  'll;!' 


nu  .nnain:  ni  'ccctner  •'rt.iuuce.s: 


,  uie  '  m  ~  . 


-y,  V  =  -20 


1  — "  M  -  — '  y 

I  =0''  j  j  =  0 


(3.13) 


.'T. w,v.n-  . ..',v  /.y, 


Alter  changing  signs  a  system  ol  two  linear  equations  Ibllows: 

4-^25=  20 

X^D-^-X^C=2 


x'here 


Aprivme  t.'ramcr  ruic  'aivcs 


Substitution  vieids 


3r  expiicitiv 


1 

'Tl  y 

j  ='> 

]=')'  J 

\ 

•zee  -  ZB 

AC  -  B“ 

ZA  -  ZBB 

AC  -  3‘ 

\  V  -  \ 

1';  2 

J 

2f 

J 

■n  ,  *n 

■n  V 

)-■  '  T,> 

y-  -n 

_  _  ^  V 


^  V  1 

%  -Z  \  1 

,  =|)  ;=0^J 


,  ^  V  ■ 

(  V  IZ  ) 

— ,  1-'  ' 
;=()  J 


Note  ’tuit  'i'.c  donominator  :uu  il  to  /ero  n  .asc  = 

iinprcbaric  c. cut. 


W.V  r.  -'.^4*' 


s  •■  >•  XiT '  _A  ^  j^V  ' 


Since  the  Hessian  matrix 


0  0 


IS  positive  dciinitc  (  .■  >  0;  for  ally),  the  solution  is  a  global  niinimuin. 
The  iinai  jouation  for  the  variance  estimate  is: 


,  -71  y  n  ,  T  V  I 

1^2)  C  .  =  1  ^  ^  - 

“oT  - 


;=0  J  =  0^;  ;=0  j 


Xo'.v  the  eiiuiitions  TJ',  l.ai  and  ■  T' 2)  contain,  ail  that  is  nccessaip.’  to  implement  the 
procedure. 

C.  THE  WF  PROCEDURE 

1.  Find  =  l.l--'’..+  l.m>-  =  |.,nh 

2.  Fix  tiie  actual  scarcii  resolution  R  (.depending  on  = 

3.  Set  up  the  grid  v.  ith  resolution  R  over  the  interval  -r  w). 

I.etk-'.vR) 

Fvaiuate  the  likelihood  I'unction  at  cadi  grid  point. 

A 

5.  Find  the  0.^.^  i  by  picking  the  "best"  grid  point  solution  o"  equation  (ir.l.j)  in 
interv.ai  T  using  mm  of  2I\  *  1  adjacent  likelihood  function  values  for  integral 
.mproximatioii. 

■Ice  ‘.ppenai.x  .5  'or  ieiaiis  m  Inmiementaiion i. 

’.  ‘  .minute  I ,  ey  eviuaiion  •  .I'  d;. 

D.  PR.-VCTIC.AL  CONSIDER.VriOiNS 

.\  mimoer  of  issues  reiatca  o  impiementing  the  '.’nT-'  procedure  on  a  digital 
-■min'iicr  re  irtcu  .lem.v.  liiese  .om-iaertaiom.  vere  'ised  ,;i  m  emulation  -iescribeu  m 
'he  .text  'T.apter. 

i  Grid  setup 

1  he  exhaustive  search  O'-cr  the  inter.al  T  =  |0  .0  1  mav  be  performed 
over  a  pre-speciiied  umber  of  points  to  be  checked  or  using  a  pre-speciiied  search 
resolution. 


The  first  approach  is  wasteful  when  T  is  small  and  the  second  approach  is 
wasteful  when  T  is  large.  Thus,  it  would  seem  reasonable  to  specify  both  a  desired 
resolution  and  an  upper  bound  on  the  maximum  number  of  points  to  be  checked, 
which  remain  constant  over  time. 


v  erv  aense  Doservatjons 


In  'he  jase  when  T  w  .-erv'  short  there  mav  be  two  comDiications: 

A 

hwatise  'n  oitition  •'rchiems  9  .  :nav  mke  exact  value  if  T  :r  9 

:  nin  :ia.\ 

’.1  'ins  case  eauaticn  inav  icrce  C  .  eaual  to  the  ccrresccndina  e 

'!  1  -  '  - 

is  not  ncnt. 


.  innu'ina  ov  >  ,  ivnii  aiue;;  vcr.'  eiose  togetner  mav  -.icia 

..;mer:io’.v  .ma  aivnion  oy  :ero. 

in  ercer  to  prevent  these  problems  tb.e  ibilouang  inodification  is  sugge.steci 
and  -vas  imd  in  tite  'a;e'.u;ations:  f  T  is  very  short  'say  less  than  3  times  resolution) 

A 

'etb,_  tc  ee  ecuai '0  meupoinc  and  ^■omnuteC^_,  esing  ' 

L-r^  smail"  .tumuers 

'V’lon  m  is  urge,  the  akeiiiiood  function  takes  ver.-  low  values.  To  avoid 
unuerf.cv.'.  simply  muitipiy  it  by  a  large  constant.  The  constant  that  was  used  Ln  tiie 
mnu..ticn  is  luZd'T 


bite  more  modification  was  implemented  to  avoid  arithmetic  '.vitn  ver.’  smail 
numbers.  If  the  exponent  of  the  likelihood  function  first  term  was  less  than  —  IdO. 
the  hkeifiiocd  function  .vas  set  to  be  equal  zero.  The  meaning  of  the  .mcdiilcation 
IS  'hat  the  procedure  considers  any  target  step  larg'cr  than 
^  '  stanuard  deviation)  to  be  a  practically  an  impossible  step.  (One  must  be  careful 

'■■■’iti-.  men.  m.odiiications  large  target  jumps  .tre  possible,  as  couid  occur  if  the  mcdei 
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IV.  SIMULATION  RESULTS 

A.  SIMULATION  DESCRII  TION 

A  simulation  experiment  was  performed  on  an  IBM  3033  and  -*381  at  the  Naval 
Postgraduate  School.  The  programming  language  used  'vas  FORTPv.AN-".  ind 
single  precision  was  used.  Normal  and  Chi-square  random  numbers  were  generated 
with  the  aid  of  h'  lSL  hbrarv  routines.  Scuaent-t  random  numbers  were  generated 
from  normal  and  dh.i-vquare  random  variables  with  appropriate  uegrees  of  frceaoin 
(see  [Ref.  S]  ).  Tracking  error  statistics  were  computed  using  the  HISTGP  subroutine 
from  the  NONTMSL  libran.'  at  NPS.  Figures  were  generated  using  an  IB.M 
experimental  graphics  package.  GR.\FSTAT. 

For  rach  simulation  replication  the  tracking  sequence  was  performed  for  '.0<> 
steps  .  (i.e.  1  =  [.1 . 1()0).  The  number  of  replications  was  1000  in  ail  cases. 

The  KF  and  ’■■VF  procedures  iwith  diiTerent  values  for  w)  were  carried  out  using 
the  sam.e  random  numbers.  iWith  normally  distributed  target  steps  and  Student-t 
distributed  measurement  errors). 

A 

Statistics  were  collected  on  tracking  errors  6  _,“9  for 

•t  -  1  =  l,d.5.iO."5.ii.i<). 

The  simulation  was  performed  for  6  cases: 

Case  I  -one  observer.  <Tj  =  I 
Case  2  -two  observers,  tr,  ='?-=  1 
Ca:;e  3  -three  mservers.  '7.  =  tr,  =  a,  =  1 
T-.se  -  -tiiree  ooservers.  r.  =  ■>,  =  i;  T-;  =  3 


Case  5  -five  ooservers,  <7,  =  *7,  =  <7,  =  »7 .  =  <7,  =  1 
Case  6 -five  observers,  cr.  =  *7.,  =  a,  =  1;  (7,  =  (7.=  3 

In  all  cases  the  m.easurement  errors  of  the  observers  have  the  Student-t  distribution 
vitn  <•=  .’  iegree:'.  :f  .Veedom  md  caie  <7  .  and  the  target  las  normafv  iisirfouteu 
step  sates,  vitn  itanuaru  ceviatton  1.  In  ail  eases  the  'A'F  procedure  'vas  perfornieu 
Icr  values  .v  =  0.1.2. 3.  Excluding  case  I,  the  desired  grid  resolution.  DR.  was  chosen  to 
be  0.1.  In  case  I,  the  desired  resolution  was  equal  to  0.05.  Case  1  is  most  susceptible 
to  problems  resulting  from  a  vc.'-y  short  interval  T  described  in  the  previous  chapter. 
In  ail  ca‘:cs  the  nu.mbcr  of  grid  points  on  the  interval  T  was  linutod  by  upper  bound 
of  50.  (See  Appendix  B  for  details  on  resolution  and  grid  setup.) 


After  fixing  a  grid,  the  likelihood  function  was  evaluated  at  each  grid  point  over 
the  interval  of  length  T  +  2vv.  The  integral  was  approximated  by  the  sum  of  2k +1 
values  of  the  likelihood  function  with  k  being  the  largest  integer  not  exceeding  iv  R. 


B.  WF  PERFORMANCE 

Figures  C.I  tlirough  C.6  display  comparisons  of  the  standard  deviations'^  oi' 
the  trucking  error,  9,_;  .  for  the  KF  and  the  WF  for  cases  I  through  'u 

respectively.  In  ail  the  cases,  the  W'F  performance  is  considerably  better  tnan  the  KF 
performance.  See  .\ppendix  A  for  tabuiateu  results. 

Figures  C.~  and  C.S  dispiav  'VF  'racking  error  standard  deviations  '.vith  different 
values  of  ■-v.  The  optunai  w  is  somewhere  in  the  vicinity  of  1  or  2.  but  sensitivity  to  tne 
e.xact  value  of  iv  is  low.  See  .Appendix.  .A  for  exact  numbers. 

C.  SENSITIVITY  AN.ALYSIS 

For  sensitivity  unaivsis  purposes,  the  tracking  sequence  was  performed  on  cacii 
case  with  the  sarnie  steps  and  measurements,  but  the  WF  procedure  used  the  foilowing 
(, wrong;  assumptions: 

(T.=  0.o  or  (T,.=  1.0  instead  of  <7,.=  1.0  or  (7.=  3.0  (underestimating  the 
measurement  variance  by  a  factor  of'di 

d.=  6  instead  ofd.-=3  (underestimating  the  measurement  variance  by  a  factor 
of  21 


':  =  i).d  instead  of  ■:=  I  (underestimating  the  target  step  size  variance  by  a  factor 

of  d) 

•Additional  runs  were  performed  when  target  step  size  was  a  Student-t 
distributed  variable  having  3  degrees  of  freedom  and  variance  equal  to  1. 

n  ni  ;ens;t;v:tf  -uns  me  'VF  ised  ^v=3  and  the  desircu  resolution  vas  euuai  m 
'.1.  .\isc.  the  mattimai  nunicer  of  points  ;n  die  interval  T  vas 

Figures  C.O  threugn  C. Id  uisplay  'vVF  performance  unuer  sensitivity  analysis 
conditions  .'or  cases  1  dirough  b.  resoectiveiv.  Ciearlv  the  W'F  oroccdure  is  '.er.'  robust 


".Ail  the  results  presented  m  terms  of  sample  standard  deviations,  i.e.  a  square 
roots  of  tite  u,>;.cii.:.scd  estimates  of  population  variances.  Means  are  not  presenteu 
since,  in  ail  cases  for  both  filters,  mean  error  values  were  vcr.-  small.  R.MS  (supuare 
PvOOts  of  .Mean  Supuare  error)  '.aiues  were  also  computed  in  the  simulation.  In  ail  runs 
insnected  'tire  vast  muiontv  from  ail  runs)  R.MS  values  were  were  shchtlv  '.mailer  tnan 


the  standard  deviations  values  idue  to  division  by  N  in  R.MS  computation  and  division 
by  N  —  I  in  standard  deviations  computation). 


with  respect  to  measurement  error  parameter  estimation  and  less  robust  with  respect 
to  major  alternations  in  target  movement  model.  See  Appendix  A  for  tabulated 
results. 

The  strange  behavior  of  the  standard  deviation  plot  with  t-distributed  target 
step  sizes  is  explained  by  the  ibilowing  phenomena:  in  ’ery  rare  ja.ses  '.vhen  'lie 

A 

estimate  0^  and  actual  target  position  are  extremely  distant  (tlie  target  ma.xes  a 

huge  stem,  \VF  starts  to  "-gnore"  the  incoming  measurements,  '"cgarding  'lien;  i,', 
outliers  ind  sticks  'o  tiie  old  estimate.  !n  such  -dtuaticn.  C.  is  increasing  teadiiv  'iit 
ao'.viy  bv  !:  ouch  time  steo  -  uue  to  the  vromt  tareet  modeii.  b.i'tjr  ome  :me 


which  mav  oe  is  nanv  as  'd  ume  steosu 


teccmes  vert  .aree  ma  a  ’■  tons 


disregarding  observations  and  the  estimate  shifts  toward  the  actual  target  position. 
(The  last  modification  descnbed  in  the  previous  Chapter  was  harmrui  in  this 
situaticn.  / 

Such  unaesired  ?ehavicr  mav  oe  treateu  by  ad  hoc  idiustments  to  'he  AT 
procedure.  For  exampie.  after  detecting  a  steady  increase  in  we  may  aroitrar^t  sot 
equal  to  a  iarge  number  and  recaicuiace  the  iasc  estimate.  This  kind  of  adjustment 
may  be  proper  when  actually  implementing  WF  if  there  is  concern  about  the  normality 
of  target  step  size.  None  of  these  adjustments  were  implemented  in  the  simulation 
experiment.  It  is  anticipated  that  if  an  outlier-productive  mode!  of  the  target  motion 
were  used,  the  etfect  noted  would  be  automatically  reduced,  but  to  date  no 
investigation  has  been  made. 

.Another  comparison  was  made  between  the  WF  and  KF  procedures  by 
performing  a  simuiation  experiment  with  normaily  distributed  measurement  errors. 
T'.ie  simulation  was  nert'ormed  for  eases  la-wi.  :fascs  ia-'u  corresnonu  'o  iiusos 
msnectivoiv,  vun  aormaiiv  ..istributeu  neasurcmcnt  errors  uavimz  ’.ne  ame 
variance  is  '-distrfoutoa  errors  m  "ne  original  eases.  Once  again  ’.ne  AT  iscd  v=  d 
and  the  desired  resolution  was  set  to  0.1  with  a  maximum  number  of  points  in  tite 
interval  T  ef:'). 


cures  ' :  ;nu  .i.soiav  uie  eomnarison  ii  -F  ..iiu  i 

:r  .U'C'.  .u-'-u.  i"  s  ruuent  mat  me  .luvantaue  ii  OF  ever  A'F  m  eas.. 


roceuLirc'' 


man  me  suneriority  oi  'A  F  over  iOF  in  cases  !-\  bee  Anoendix  .\  for  ta’oul.ated  resmts. 

In  order  to  see  now  much  measurement  error  assumptions  may  be  violated, 
several  more  runs  were  made  asine  the  Caucirv  distribution  iStudcnt-c  with  1  d.f.  - 


parameter  o).  In  general  the  tracking  was  steady.  However  in  very  extreme  cases, 
when  the  interval  T  was  extremeiv  long  and  the  old  estimate  0  was  not  one  of  it's 
endpoints  (actual  resolution  in  such  cases  became  extremely  large),  WF  produced 
an  unreasonable  estimate  and  did  not  recover  from  the  huge  error. 

To  overcome  :he  prebiem.  two  alterations  were  made  to  :.ne  'imuiaiion 


implementation; 

T.'ie  Ma.xmnim  .-mmber  of  Tcmcs  :j  check  x,as  set  'o  cOb. 

In  me  case  when  ail  grid  o'oints  on  'he  nterval  T  corresnonded  to  'lie  '.ntecrai 
o.a’.'.ng  a  vanae  caua.  to  i.  t.te  new  estimate  .vas  mt  m  m  eoua;  to  c)  ,  me  :;u 


e.'timate.  The  trmma;  n;n;en:c:uat;un  nrcunced  0 


or  m  .“nima: 


L  .a 


-.iscs.  dee  .Xnpenm:.  or  'etter  ipproacn  ny  mermg  ona  ‘etnn. 

.\tter  ma.hmg  these  two  alterations,  'he  runs  wore  repeateu.  The  trackins  was  -teadv 
'vitn  no  mecial  prcbi’ems.  The  results  are  tahuiated  in  Appendix  A  and  .mav  ^e 
-onsiaerea  verv  coou. 

A  eiected  numher  o;  imes  was  oncsen  m  I'eriorm  a  hrmtea  ’'ariao!;::'.' 
aemcnstraticn.  Simu.at;.^n  runs  -vere  maac  vnh  5  aiiTcrcnt  nairs  :f  meas  one  :'.ir 
target  'tens  and  one  for  measurement  errors!  for  1.2.3  ana  5  identical  observers  .mu 
AF  using  ■~-2.  The  resales  .ire  displayed  in  Figure  C.I~.  Ceneraily.  '••ariabhiry 
'.'et'.veen  ciiTerent  pairs  :f  seeds  aoes  not  exceed  the  variability  bev.veen  senarated 
time  stens  for  a  sinsle  seed. 
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V.  FINAL  DISCUSSION 


The  WF  procedure  has  a  ven.'  general  nature.  It  may  be  applied  directly  to 
any  type  of  measu’-'ment  error  distribution.  The  distribution  of  measurement  error 
must  have  finite  variance  and  known  densitv  leven  in  taouiar  form).  Tlie  WF  lilter 
performance  with  e.KOtic  distributions,  using  right  or  wrong  distributional 
assu.mn'’io:is.  neeus  to  oe  ini'estigateu. 

To  mpiy  tne  W'F  procedure  o  moueis  with  non-norir.ai  target  ten  -ize  ttiere 
must  be  an  etficient  wav  to  evaluate  the  conditional  likelihood  function,  or  else 

A 

additional  assumptions  have  to  be  made  regarding  distribution  of  the  estimate  9„ 
before  and  after  movement  of  the  'arget.) 

Vhen  applied  to  moueis  with  normally  distributed  .measurement  errors 
(and  normally  distributed  target  nep  sizesi.  the  WF  procedure  iwitn  any  ao  ;s 
theoretically  identical  to  the  KF  procedure.  In  practice,  however,  there  might  be  some 
difference  in  performance  due  to  finite  resolution. 

WF  has  a  built-in  tuning  parameter;  the  value  of  vv.  The  optim.al  value  for  w  is 
definitely  not  zero,  but  the  sensitivity  of  the  procedure  to  the  exact  vaiue  of  a'  is  low. 
The  best  values  of  a  seem  to  be  in  the  range  '  r.  2t).  where  t  is  the  stanuard  deviation 


of  the  target  step  size. 

Instead  of  using  a  as  a  static  tuning  parameter  where  it  is  kept  constant,  a  mav 
be  computed  dynamically,  based  on  the  latest  observations.  For  example.  a=T  - 
ccnstraineu  ;o  >nd  a-v-  .inu  the  usual  procedure  fir  trie  <etup  ■ 'ce  .\ppenu;\ 

3>  orouuceu  very  coou  .'csuits  .or  oil  .uses,  vur  v.as  :iot  iiDcrior"  '.o  me  resu.rs 
obtaineu  .vicn  constant  -v.  ■  Dvnamic  a  results  were  not  representeu  :n  uie  -^revicus 


Chapter  i. 


.\notiier  modification 
■s  use  }[  :ion--v;nnietr;c 
vitn  .0  .vcr  emit  d  ,  _  -  a. 

Fjuuticn  i  may 
any  “gcou"  procedure  'peci 


to  VC  expiored.  ;i'  it  van  be  -ustii’ca  bv  operational  reasons, 
inters  VI  n  aiuation  ■h'.i.u  -.  ve.  ■'cricrminc  integration 
.inu  irper  irnn  d,_  -  .v,  . 

be  useu  not  oniv  as  part  ot'  WF  procedure,  but  .is  part 

A 

fying  0^__  j  and  looking  for  j  . 


'Optimal  rule  for  dynamic  a  calculation  may  be  discovered  by  further  research. 
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The  most  noticable  difference  between  the  KF  and  the  WF  with  respect  to 
estimation  is  that  in  the  KF  case  depends  only  on  n,  converging  to  some  value  as  n 
increases,  and  in  the  WF  case  is  more  dynamic,  depending  on  the  actual 
measurement  values.  The  dvnamic  behavior  of  C  reflects  the  variable  amounts  of 

*  -T 

.nformaticu  received  .u  each  measurement  step.  This  phenomenon  iives  m  '‘inside'’ 
performance  measure  an  how  well  the  filter  is  doing.  None  of  the  cases  checked  bv 
■•imuiation  re. mired  corrective  actmns  due  to  aonormial  C,  behavior  re.  steauv 
mcrease  or  large  pumrsi.  except  when  target  siep  sizes  were  Student-t  distributed. 

.muted  ;:mnec:;cn  of  T.  '  aiues  calculated  by  the  'A'-  procedure  muicates  mat 
ne  l',  'a:..es  comnuteu  .re  semewnat  larger  nan  the  actual  variances  if  tracxine 
errors.  1:  mav  conjectured  that  there  is  room  for  improvement  in  the  WF 
’'rocedure.  (3n  the  other  hand,  forcina:  C  close  to  its  true  value  J known  from  previous 

‘  -  T 

'emulations  i  ''rouimcs  -cood  but  not  superior  .-esuits  to  those  obtained  m  the  regular 
vav.  .liing  ea.iatmn  This  suggests  tnat  tne  WF  procedure  is  fairiy  rooust 

tv::h  re'pect  to  modest  manges  in  the  computation  process.  i.A  constant  value  for 
may  oe  used  if  mere  is  sutTicient  knowledge  of  the  environment,  i.e.  tne  values 
that  should  be  obtaineu  are  aprrc.ximately  known  and  no  large  jumps  in  values  are 
expected). 

Extending  tf.e  'V^'F  procedure  to  the  multidimensional  case  does  not  seem  to 
pose  conceptual  problems.  Fquaticn  ■  IF. l.a!  may  be  replaced  by  an  integral  over  a  k- 
dintensional  rect.ingle.  The  analog  to  equation  i  IF. 2)  may  be  obtained  by  nunimizing 
tile  cctcrnunant  or'  fie  covariance  matrix.  However,  the  computational  burden  or" 
.. It. cn  '  F  y,;i  In  ''.ne  's-di.mensionai  case  and  rruni.mizing  tlic  deternunant 
mwC's;,,:.  ")  icm.i.lv  'rnpicmcri:  the  U'F  prcceuiire  :n  me 

sicrtti.  mt mmnmcnt  vp.,d  :'e::!iire  m  micient  ’vav  soive  cauat.on  • 


11  vine 


II 


covariance  matrix. 


V, 


NT-f ;.-.sv.: 


_'i  .«■ 
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APPENDIX  A 

TABULATED  RESULTS 


This  Appenaix  contains  'anles  oi'  trackin"  error  standard  deviations.  T.c 
tables  are  oraanized  'iv  observers  connsuration. 


1.  'Table  1 
'T'  lbio  T 
3.  Tame 
'.'anie  - 
b.  Table  5 
6.  Table  6 


<  .rie  ai'servor. 

T'.vo  aenticai  ob'-ervers. 

Three  hentica;  inservers. 

’’lirce  lovorvers.  me  iT  vnom  is  '  'imcs  iess  leciirate  'iian  'ne  nners. 
Five  identical  observers. 

Five  observers,  two  of  whom  is  3  times  less  accurate  than  the  others. 
The  Tollowine  notation  .s  .iseci  ;'cr  sneeiiVmg  target  ■:.ten  si/tc  and  measuremetit 
error  distributions: 

•  v'  -  normal  .vun  mean  ')  and  variance  v 

•  tiu.Si  -  Stuuent't  with  d  uegrees  of  freedom  and  scale  parameter  <7=  s 

When  two  f,  pes  of  ooservers  are  involved,  tiie  parameters  are  given  for  th.e  more 
accurate  ones. 

.All  cases  above  the  double  line  use  precisely  the  sarnie  target  steps  and 
measurement  errors:  onlv  tiie  filters  are  ditferent. 

Filter  notations: 

KF  Kalman  filter  using  correct  variance 

''\'F  ■v=i  'A'-filter  using  3  i.f.  •.■.■  =  ;  and  correct  variance 

"'v  F.v  =  '.  .'7  'A'-:;lter  using  3  :..l.  v=  .  and  assiimins  '..be  sca;e  ti TiC  '  s  .(T 

':t:ier  nan  me  :rue  parameter  or  iir  lacn  toser’vir 

=  ..3u  ".'-.liter  .rsing  .v=  .anu  as,sumjng  mat  me  dtuaent-t  aegrees  m' 
.reeuena  are  3u  ratner  man  me  true  vaiue  ui’u 


T\' 


s-nuer  me  tcrroct  measurement  viramcters  ina  i,'  'Urn:ng  me 
■i.nnari  iev  ui; m  if  me  arge:  te-^  me  s  .r  •mner  man  me 
me  .■..me  ;  " 
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TABLE  I 
ONE  OBSERVER 


TABLE  3 

THREE  IDENTICAL  OBSERVERS 


TABLE  5 

FIVE  IDENTICAL  OBSERVERS 


inn 


\VF  . 
\VF 


WF 


1.52') 


‘V'')  s 

‘Ao3i 


1.3^6 


''iA(-(3 


•.).^2 
'  •.(}35 


TABLE 

FIVE  OBSERVERS.  TWO  3  TI.MES  WORSE 


T 

i-  I  w  IN 


Track.  Length 


APPENDIX  B 

DETAILS  ON  IMPLEMENTATION 


In  :nis  Appencix  :he  ’.mpienier.raticn  of  ‘.ne  simuiation  expenmen:  ;s  discussed. 
•  There  are  rr.anv  uiiiercnt  wavs  :c  imnwiTienc  tr.e  WT  procedure.)  in  particular  the 
.rr.pieruentaticn  ui'  uie  :r;d  etup  inu  -'earc.h  :hr  maximal  inceerai  over  ntervai  with 
leneth  2.v  'viil  -c  expuuncu. 


GRID  SETl  ? 

T-vo  parameters  exciudmu  -.‘i  .antroi  uie  end  setup: 

1)  DR-  •;ie  ue'-'ired  resolution  usuaiiy  DR  =  r).  1  ;■ 

2)  GMAX  -  'he  inaxiniai  nuriu'er  points  "a  -earch  ■  usua 
he  ;irsc  -tep  m  inu  inter'sai  ~  =  '3 

^  ='n.7i''3  .■  . 


Iv  \MAX  =  -■')) 


15  in  na.\' 


•After  finding  T.  the  desired  number  of  searc.h  points,  n  is  computed:  n  =  'T  DRl—  1. 
If  n>  NM.AX.  then  n  is  set  to  be  equal  to  NMAX. 

In  the  next  step,  the  .tctuai  resolution  R  is  computed;  R  =  T  n  . 

.After  fixing  R.  the  nummer  of  points  on  interval  -v.  k.  is  computed:  k  =  f'.v  R).  (If  .v  is 
com.puted  dynamucaily  its  vaiue  may  cnangei. 


New 

.lavin 


.irr^v. 


tne  grid  is  fixed  to  have  total  number  Di'n-dk-l  equailv  R;  -'paceu  points 
g  n—  1  points  in  interval  7  itsci:''cne  cn  lacn  end). 

dkeiii'.ooa  .unction  aides  .ire  evaluated  .or  eacn  gnu  ;^c;nt  ana  toreu  n  an 
'  In  '.te  'Urne  order  mat  '.ne  grid  •'Oirits  .trpe.ar  on  me  ma;  ntimmer  iinei. 

•A  more  econoirucai  way  to  set  un  me  end  vouid  be  as  follows; 
ivaiuate  'he  ikeuiiood  .unction  it  'tie  endpoints  if  nter'xii  7.  i:'  die 
GOd  .s  'osui'.'o  .t  sotn  inds.  ^rocccd  .s.  aescrmcd  .no'-e.  .[  me  .kenimod  s 
Id uai  '  ,n  me  ir  'wo  irmpoiiits,  men  minmate  tile  .orre pondme 


msen.  Ill  on.  recompute  mtervui  uid  repeat  me  "iroceuure.  77i;s  'vas  not 
.mpiem.ented  .n  tite  simulation  experiment.  ■ 


dv 


2.  SEARCH  FOR  MAXIMAL  INTEGRAL 

Once  all  likelihood  values  are  stored  in  the  array,  the  search  for  the  maximal 
integral  was  implemented  in  the  following  way. 

Initiation  step;  compute  sum  of  first  2k +1  values  from  the  array.  This  sum  is 
tire  integral  approximation  corresponding  to  0,^.^  .  Tiiis  is  the  first  canuiaate  ;'or 

Search  ioop:  .idvance  on  tiie  irrav  eacn  time  ..luuing  .i  new  element  to  tne  -aim 
and  subtracting  the  eldest  one.  If  the  new  ,um  .s  larger  tnan  the  larges:  am.ong  die 
aid  ones.  tiiKe  '.'le  eorresronuing  gnu  pome  is  tne  'est  canaldate  so  .hr  ana  record  tiie 
.  irgest  sum.. 

.After  n—  1  repetitions  the  procedure  gives  the  best  candidate  among  the  n—  i  grid 
points  on  interval  T  .and  the  corresponding  mtegrai  vaiuei. 

This  implementation  arnreaen  was  ..nosen  nainiv  because  jf  ns  iigoritnnuc 
iimpucttp.  .Auding  mu  suctracting  iliZ.vL  numoers  reretitiveiv  nugnt  ntroutice 
some  rounu-cif  error.  Tins  is  not  a  real  rrcoiem  m  present  case  oecause; 

•  :<)  additions  ana  suotractions  .s  not  a  ver-’  ;arge  numrer. 

•  The  interest  .s  m  tne  gnu  point,  not  tne  corresponaing  .ntegrai  .  aiue. 

•  In  close  cases  when  round-oif  error  is  reversing,  the  test  ;an  '  ’re  ^ure  anmv.iy 
because  of  finite  resolution. 


APPENDIX  C 

COLLECTION  OF  FIGURES 


in  this  Appendix  seventeen  Figures  presenting  the  WF  performance  (compared 
with  the  KF  perfcrm.ance)  are  collected. 

•  Figures  C.i  tiirough  C.o  present  WF  vs  KF  comoarison  for  cases  1  through  o 
respectively.  WF  performance  is  given  for  values  of  w=0. 1.2.3.  The  cases 
-orrespona  to  following  Doserver  configurations; 

(Dne  cbser''er 

Two  iaenticai  observers 

Three  identical  observers 

Three  observers,  one  of  whom  3  times  less  accurate  than  the  others 
"i'.'e  identicai  obser'  crs 

Five  ooservers.  two  of  vnom  3  times  less  accurate  tiian  the  nners 

•  Figures  C.'  and  C.-S  present  '-VF  performance  with  wuii  jilTcrcnt  values  of '.v 

Figure  C.“  -  cases  1,2.3 
Figure  C.3  -  cases  -.o.o 

•  Figures  C.9  through  C.1-!  present  sensitivity  of  WF  performance  tvith  respect  to 
model  violations.  Figures  C:?  through  C.14  correspond  to  case  1  through  case  6 
respectively. 

•  Figures  C.lf  and  C.16  present  comparison  of  WF  and  KF  performances  for 
normally  distributed  measurement  errors.  Comparison  presented  for  cases  la-oa. 
Cases  la-ba  correspond  to  cases  1-6.  but  have  norm.aily  distributed 
measurement  errors  with  the  same  variance  as  Studcnt-c  distributed  errors  un 


iricmai  cases. 


(cnts  .uses  .a-;a 


Figure  presents  cases  -i.a-na 

Figure  C.!"  uispiays  variabiiitv  of  the  sim.ulation  using  dilTerent  seed.s.  Five 
^a;rs'  cf  seeds  ire  used,  '•'.iriabuitv  is  nresented  lor  cases  i.2,3.c. 


wv 


Ki  comparison  I'or  C,'aso  Ia-3a  -  Normal  incasurcmctu  errors. 
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